(GL2„(C),5p2n(C)) IS A GELFAND PAIR 

EITAN SAYAG 

Abstract. We prove that (G'i2n(C), S'p2n(C)) is a Gelfand pair. More precisely, we 
show that for an irreducible smooth admissible Frechet representation (tt, E) of GL2„(C) 
the space of continuous functionals Homgp^^(^c){E^C) is at most one dimensional. For 
this we show that any distribution on G'i2n(C) invariant with respect to the double action 
Sp2n{'C) X Sp2ii{C) is transposition invariant. Such a result was previously proven for 
p-adic fields by M. Heumos and S. Rallis. 



1. Introduction 

Let F be a p-adic field (i.e. a local field of characteristic zero). It was proven in [HRj 
that {GL2n{F), Sp2n{F)) is a Gelfand pair. A simple proof, for the case where F is a finite 
field, appeared recently in [GGj . In [0S3] we used Proposition 3.1 of |GGj to simplify 
the proof of the p-adic case (the idea of proof, namely the usage of the Gelfand Kazhdan 
method remains the same). 

Our goal in this note is to transfer the result to the archimedean case. This is the first 
step in extending the joint work of Omer Offen and the author (see |OSlj . |US2j . |0S3j ) 
to the archimedean case. 

More precisely the main result of the present note is the following: 

Theorem (A). Let {tt, E) he a irreducible admissible smooth Frechet representation (vr, E) 
ofGL2n{C). Then the space of functionals Homsp2„{c){E,C) is at most one dimensional. 

Following the standard technique of Gelfand and Kazhdan we first show 

Theorem (B). Let T be a distribution on GL2n{C) invariant with respect to the double 
action Sp2n{'C) x Sp2n{C). Then T is transposition invariant. 

For the proof we will use an analogue of Gelfand-Kazhdan criterion as proved in [AGSj 
as well as the strategy of [AG2j - jAG3j . Namely, we verify that the symmetric pair 
GL2n{'C), Sp2n{'C-)) IS good and that all its descendants are regular (See section [2] 
for the exact definitions of these terms). We hope to cover the case {GL2nO^), Sp2n{^)) 
in the near future. 

We have made an attempt to make this note as self contained as possible. Since our 
proof relies heavily on the notions and ideas of |AGSj and |AG2] we summarized those 
in section [2l We introduce the notion of Gelfand pair and review the Gelfand-Kazhdan 
distributional technique. 

We then review some notions and results of |AG2j . especially the notions of symmetric 
pair, descendants of a symmetric pair, good symmetric pair and regular symmetric pair. 

The formal argument is given in the section [S] while the key computation of descendants 
of our symmetric pair is done in section HI 
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In this section we review some notions and result concerning Gelfand pairs. We follow 
the notions introduced in [AGS] and |AG2j . 

2.1. Notation. We let F be a p-adic field, i.e. a local field of characteristic zero. We 
denote algebraic F-varieties by bold face letters. Thus X is an F-variety and X = X(F) 
is the set of its F-points. Note that when F is non-archimedean X is an £-space (as in 
[BZj ) while for archimedean F the set X has a structure of smooth manifold. We consider 
the space S*{X) of Schwartz distributions on X. For F non-archimedean these are just 
linear functionals on the space S{X) of locally constant functions with compact support 
on the £-space X. When F is archimedean we consider X as a Nash manifold and use 
the Schwartz space of [AGl] . We note that the main result of the paper, Theorem B, 
holds true when one replaces S*{X) with V^X) the space of all distributions on X (see 
Theorem 4.0.8 of [XG2]). 

The letters G, H denotes reductive algebraic groups defined over F. The groups of 
points of which will be denoted by G, H respectively. 

When we consider symmetric pairs we refer to triples X = (G, H, 9) of reductive F- 
groups where 6' : G — > G is an involution and H = G^ is the fixed point of 9. The 
ant i- involution (y{g) = 9{g~^) and the symmetrization map s{g) = (y{g)g G will play a 
key role. 

For a symmetric pair X we will denote by X{F) the pair of groups {G,H) of corre- 
sponding F-points of the groups G, H. 

If A,B are matrices we will use the notation diag{A, B) for the block matrix whose 
blocks are A and B. 

For n > 1 we let On = GL[n) and let be the non degenerate skew symmetric matrix 
of size 2n given by 



2. Notations and Preliminaries on Gelfand Pairs 







n 



In 




Clearly, 



is an involution on G2n and we have 



H2n = Gt = {ge G2n ' gJ2ng = ^2n} = Sp{2n) 



We record the anti-involution 



(^2n{g) = On{g ^) = J2n^gJ2n 



and the symmetrization map 



s{g) = gJ2n*9J2> 



In 



(GL2„(C),Sp2n(C)) IS A GELFAND PAIR 

2.2. Distributional Criterion for Gelfand pairs. 



3 



Definition 2.2.1. Let G be a reductive group. By an admissible representation of 

G we mean an admissible representation of G{F) if F is non-archimedean (see [BZ\) and 
admissible smooth Frechet representation of G{F) if F is archimedean. 

We recall the following three notions of Gelfand pair. 

Definition 2.2.2. Let H G G be a pair of reductive groups. 

• We say that {G,H) satisfy GPl if for any irreducible admissible representation 
(vr, E) of G we have 

dim H am H(^p){E,C) < 1 

• We say that {G,H) satisfy GP2 if for any irreducible admissible representation 
(tt, E) of G we have 

dim H am H{F){E,C) ■ dimHomH{E,C) < 1 

• We say that {G, H) satisfy GPS if for any irreducible unitary representation 
(tt, 7i) of G{F) on a Hilbert space H we have 

dim HomH(F){'H'^X) < 1- 

Property GPl was established by Gelfand and Kazhdan in certain p-adic cases (see 
jGKj ). Property GP2 was introduced in |Groj in the p-adic setting. Property GPS was 
studied extensively by various authors under the name generalized Gelfand pair both 
in the real and p-adic settings (see e.g. |vDl IBvD] ). 

Clearly, 

GPl =^ GP2 =^ GPS. 

In |AGSj we obtained the following version of a classical theorem of Gelfand and Kazh- 
dan. 

Theorem 2.2.3. Let H G G be reductive groups and let t be an involutive anti- 
automorphism of G and assume that t{H) = H . Suppose r(^) = ^ for all bi H{F)- 
invariant Schwartz distributions C, on G{F). Then {G,H) satisfies GP2. 

In the case (G2n, -f^2n) at hand GP2 is equivalent to GPl by the following simple propo- 
sition (see [AGS] ) . 

Proposition 2.2.4. Let H G GL{n) be any transpose invariant subgroup. Then GPl is 
equivalent to GP2 for the pair {GL{n), H). 

2.3. Symmetric Pairs, GK pairs and Gelfand Pairs. We now restrict to the case 
where if C G is a symmetric subgroup and more precisely (G, H, 9) is a symmetric pair. 

Definition 2.3.1. A symmetric pair is a triple {G,H,6) where H C G are reductive 
groups, and 6 : G ^ G is an involution of G such that H = G^. 

In |AG2] the notion of GK symmetric pair is introduced. It means that the condition 
of the above criterion (Theorem 12.2.31) are met with r being a. 

Definition 2.3.2. (G, H, 0) is called GK pair if any H{F) x H{F) invariant distribution 
is a invariant. 
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In particular it follows from Theorem 12.2.31 that 

GK =^ GP2. 

We now wish to describe the main tool to show that a given symmetric pair is GK 
pair. In principle there is one obvious obstruction for a pair to be GK pair. If there exist 
any closed orbit A = HgH which is NOT a invariant then we can find a distribution 
supported on that orbit which is not a invariant and this contradicts the condition. Thus 
an obvious necessary condition is the following: 

(*) for each closed orbit HgH we have a{g) G HgH 

Following [AG 2] . we call symmetric pairs satisfying condition (*) good symmetric pairs. 

Definition 2.3.3. The symmetric pair {G, H, 9) is called good if for all closed orbits 
A = HgH we have a{A) = A. 

Thus, 

GK =^ good 

In |AG2j it is conjectured that the converse is also true and a partial result in that 
direction is proved. 

To formulate the theorem we need two notions, that of descendant symmetric pair 
and that of regular symmetric pair. 

The exact technical notion of regular symmetric pairs will be explained later and for 
the moment we note that the expectation is that any symmetric pair is regular. Later 
we will discus this notion and explain how we will verify that certain symmetric pairs are 
regular. 

The notion of descendant pairs is central for the present work. Given a symmetric 
pair (G, H, 6) we consider the centralizers in G and in H of certain semi simple elements 
X G G{F). The elements x that are considered are in the image of the symmetrization 
map and in particular satisfy a{x) = x. 

Being the centralizers of semi-simple elements these groups Hx C Gx are reductive, 
they are defined over F and H^ is a symmetric subgroup of Gx, namely the fixed point 
of 9x = 9\g^. 

Let us now describe the elements x G G{F) that we consider. Given g & G such that 
A{g) = HgH is closed it is known that x = s{g) is semi-simple and the stabilizer of x in 
H is exactly the stabilizer of g in H x H (for a proof see Proposition 7.2.1 of |AG2j ). One 
can define a baby symmetric pair {G^, H^, 9\g^) by taking the centralizers of a; in G and 
H. 

This is called a descendant of {G, H, 9). Notice that the set of descendants of a given 
symmetric pair depends on the field F over which the groups are considered. 

Remark 2.3.4. It follows from standard finiteness results that the number of non- 
conjugate descendants pairs of a given symmetric pair is always finite (see corollary 1, 
p.l07of\^). 

We can now state one of the main results of [XU2] : 

Theorem 2.3.5. Suppose that the pair {G, H, 9) is good and that all its descendants 
are regular. Then {G,H,9) is a GK pair. 
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2.4. The notion of regularity. To define the notion of regular symmetric pair we need 
several more notations. Given an algebraic representation of G we say that v G V{F) 
is nilpotent if zero is in the closure of its orbit G{F)v. We denote by T(y) the set of 
nilpotent elements. 

Consider the QiV) = (y/V^){F) and the subspace RiV) C Q{V) of regular element 
(i.e. those that are not nilpotent). Notice that since G is reductive we can realize Q{V) 
as a subspace of V{F). Thus, 

Q(V) = 

and 

R{V) = Q{V)-T{V) 

where T{V) is the set of nilpotent elements for the action of G on V. 
Let {G, H, 9) be a symmetric space. 

We now formulate two properties Distgenid) and Distaii{g)- 

DistgUg.V) ^ S%R{V)f^^^ C S*{R{V))^'^^^ 

and 

We remind that S*{Q{V)) is the usual space of Schwartz distributions on a vector space, 
while for the definition of S*{R{V)) we use the theory developed in [AGl] . 

Now consider g := LieG and the adjoint action of H{F) on the vector space g'' := {a G 
Q\9{a) = -a}. 

We expect that for some elements g G G{F) the fact that each if(F)-invariant distri- 
bution on the regular part R{V) C Q{V) is Ad{g) invariant will imply that the same is 
true for distributions on the entire vector space QiV). 

We now specify the elements g G G{F) that will play a role in the definition of regularity. 
We deviate here slightly from jAG2] . Let Z = Z{G) be the center of G. 

An element (7 G G is called relevant if s{g) := gcr{g) G Z{G) and H has index at most 
2 in the group H < g > generated in Aut{G) by Ad{H) and Ad{g). 

We denote by 

rel{G, H,e) = {geG: s{g) G Z{G), [H < g >: Ad{H)] < 2} 

the set of relevant elements. 

We can now give the definition of regularity. 

Definition 2.4.1. The pair {G, H) is called regular if for the adjoint action of H{F) on 
the vector space 0°" 

Distgenig^Q") =^ Distallig.Q") 

for all relevant elements g G rel{G, H, 6). 

Remark 2.4.2. In |AG2j the authors use the notion of admissible elements. These satisfy 
a further condition which is implied by Distgen{g, Q'^) ■ Namely, if Distgen{g,Q'^) holds 
then each closed H{F) orbit on g'^ is preserved by Ad{g). This is exactly the condition 
Ad{g)\QiT is //-admissible. Thus the definition given here for regularity is identical to 
that of [Xn2] . 
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We have the following trivial consequence of the definitions. 

Proposition 2.4.3. We have the following: 

(i) the product of regular pairs is a regular pair. 

(a) Let {G,H,6) be a symmetric pair. Z = Z{G) the center of G. Suppose that 

{g : a{g)g e Z} d ZH. 

Then {G, H, 6) is regular. 

Proof. The first point is proposition 7.4.4 of |AG2] (We emphasize that this is a direct 
consequence of the definitions and the Proposition 3.1.5 of jAGSj ). 

For the second point we note that rel{G, H, 6) is by assumptions a subset of ZH and 
hence the condition Distaii{g) is obviously satisfied. □ 

3. Xn(F) := {G2n,H2n,0) SATISFIES GK WHEN F ^ R 

In this section we prove Theorem A and Theorem B. 

For the proof of Theorem A it is enough to show that the pair {G2n, H2n, 0) is GK. 

Indeed, by Theorem 12.2.31 it satisfies GP2 and hence, by Proposition 12.2.41 it satisfies 
GPl. This is the content of Theorem A. 

Observe that Theorem B is equivalent to the assertion that the pair (G2n, -ff2n, 0) is GK 
because the anti-involution a2n is conjugate to transposition via the element J2n of Sp2n- 

To show that X„ is GK we will verify that it is good and compute its descendants. 

When F = C we show that all these descendants are regular. Thus by Theorem 12.3.51 
the pair X„(C) is GK. 

Remark 3.0.4. It can he shown that Xn{F) is regular also for F non-archimedean. We 
don't need this fact here since our proof that Xn{F) is GK will he hased on the original 
Gelfand-Kazhdan criterion that requires the verification that all the orhits A = HgH are 
a-invariant. See helow. 

3.1. The pair X„(F) is good. We first verify that all orbits are transpose invariants. 

Proposition 3.1.1. Let F he an arhitrary field. Let g G GL2n{F). Then g^ G HgH 
where H = Sp2n{F). 

The proof depends on the following lemma (which is proposition 3.1 of |GGj ): 

Lemma 3.1.2. Let F he an arhitrary field. For x G GLn{F) define d{x) = diag{x, In) ■ 
The map Ad{Gn)x H2nd{x)H2n is a hijection hetween the set of conjugacy classes 
in GLn{F) and the set of orhits of Sp2n{F) x Sp2n{F) in GL2n{F). In particular, given 
g G GL2n{F) the double coset H2ngH2n contains an element of the form d{x) = diag{x, In) 
where x G GLn{F). 

Proof of proposition 13.1.11 

Since H is transpose invariant, the statement is equivalent to 

HgH = (HgH)' 

Thus we can choose whatever representative we like in HgH. We take g = diag{x, In) as 
in the lemma. But for some k G GL{n) we have kxk^^ = x* since in GL{n) any matrix is 
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conjugate to its transposed. Taking h = diag{k, */c ^) which belongs to we have 

h • diag{x, In) • = diagi^x, In) 

as needed. 

Corollary 3.1.3. Let F he a p-adic field. Then the pair {GL2n{F), Sp2n{F)) is good. 

Indeed, by the above proposition and J2n G -f^2n we see that for each orbit A = HgH 
we have 

a{g) = fgJ G HgH 

Remark 3.1.4. For the case F = C, it is shown in |AG2j (see corollary 7.1.7) that any 
connected symmetric pair (i.e. G/H is connected) is good. 

Remark 3.1.5. The fact that the pair Xn{F) is good for any local field F can be deduced 
from the cohomological criterion given in corollary 7.1.5 of [AG2] . Indeed, all descen- 
dants are products of symplectic groups (as shown in section^ of this note) and these are 
known to he cohomologically trivial (^ [Spj In a sense the approach of |HR] is along these 
lines. 

Since all orbits of H2n{F) x H2n{F) on G2n{,F) are cr-invariant one can use, in the case 
that F is a p-adic field the work of Gelfand-Kazhdan to deduce 

Theorem 3.1.6. Let F he a non-archimedean field. Then the pair (6*271, -f^2n) is a GK 
and hence a G elf and pair. 

The complete argument can be extracted from page 6 of |0S3j but it is really an 
immediate consequence of the theory of Gelfand-Kazhdan as presented by in [BZj . 

Remark 3.1.7. Note that when F is non-archimedean the condition of regularity is not 
required in our case since all the orbits for the pair X„ are a-invariant. 

3.2. The descendants of the pair {GL2n{F), Sp2n{F))- We have 

Proposition 3.2.1. All descendants of Xn{F) are products of symmetric pairs of the 
form Xm{E) for some m < n and some E/F finite extension. 

For the proof see the fourth section where the proposition is formulated in slightly 
different form. 

3.3. Regularity of Xn and its descendants, F = C. We now restrict to the case 
F = C. 

Corollary 3.3.1. Let F = C. The symmetric pair Xn{F) and all its descendants are 
regular. 

Proof. By proposition 13.2.11 each descendant is a product of Xm{E) for some field exten- 
sion E/F and m < n. Thus, by clause (i) of proposition 12.4.31 it is enough to prove that 
Xm{E) is regular for any E/F and any m. 

Let ghe a relevant element. Then gcr{g) G Z{G2m) and since F = C we can find a scalar 
matrix a G Z{G2m) and 5^0 ^ -f^2m such that g = ago- Thus we search for a G Z{G2m) 
such that a^^g G H. We claim that any a solving the equation 
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(1) acr(a) = Z 
Will work. Indeed, 

(we use z = g(j{g)) and thus s{a~^g) = 1 showing that a^^g G H. We thus need to solve 
the equation ([T]) or 

aJ'^aJ = z 

This can be done by hands after writing z = diag(t, ...,t) and taking a = diag{r,r, ..,r) 
with r = t^/^. By clause (ii) of proposition 12.4.31 we are done. □ 

4. The descendants of the pair {GL(y), Sp{V)) 

Let F be arbitrary local field. Let (V, u) be a symplectic space over F. Let J : V V* 
be the isomorphism induced by u. J is given by J{v){u) = uj{v,u). Clearly, J* = — J 
where J* is the adjoint operator to J. 

Consider the involution 6{g) = J^^g'^J where g'^ is the inverse of the adjoint oi g : V ^ 
V. Note that the isomorphism r : GL{V) — > GL{V*) given by T{g) = {g*)~^ correspond 
in matrix notations to transpose inverse. 

The fixed point group of 6 is the symplectic group 

Sp{V,J) = {geGL{V):Jg = g^J} 

Clearly, this is the group of automorphisms of the symplectic space (V, uj). The symmetric 
pair {GL{V), Sp{V, J), 9) will be denoted Xv,j. 
The aim of this section is to verify the following 

Theorem 4.0.2. Let F be arbitrary local field. Let Xy j be the symmetric pair as above. 
Then all descendants of Xy j are products of pairs of the form X^j where {W, I) is a 
symplectic space over a finite extension E/F with dimE{W) < dimpiV). 

For the proof of the main result of the note we need the above only for the case F = C 
In that case it can be proven by brute force. One can treat arbitrary local field using the 
method of |SpSt| as we now show. 

We recall the formula for the centralizer of a semi-simple transformation. Remind that 
for a semi-simple element x G GL{V) the minimal polynomial P = min{x, F) is a product 
of distinct F-irreducible polynomials. Moreover, if P = nr=i then 

(2) V = m 

with Vi = Ker{Pi{x)). Note that the adjoint operator yields a decomposition V* = Q)V* 
where V* = Ker{Pi{x*)). Here x* -.V* ^ V* is defined by 

x*{£){v) =£{xv). 

We have x'^ = (x*)^-^. 

Notice that each is a vector space over the field Ei = F[t]/{Pi{t)). Also, an element 
that commutes with x must preserve the direct sum decomposition V = (BVi and clearly 
commutes with the action of each Ei on Vi. Thus, 
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n 

GL{V), = \{GL{V,,E,) 

i=l 

The content of proposition 2.8 (page E-89) in |SpSt | is an extension of this well known 
fact to describe the centralizers of elements of classical groups. We need a related result, 
namely a description of centralizers of elements that satisfy x = cr{x) (as opposed to 
X = 9{x)). Let us present the result in the case where V is endowed with a symplectic 
form uj or equivalently with J : V ^ V* which is an isomorphism and anti-self dual. We 
remind that 9{x) = J~^{x*)~^J and a{x) = J~^x*J. 

We will require two simple lemmas. 

Lemma 4.0.3. Suppose x = a{x). Then the decomposition ^ V = Q)Vi is orthogonal 
with respect to uj. 

Proof. First note that the condition Jx = x*J is equivalent to uj{xv,u) = uj{v,xu). Let 
V G Ker{P{x)) and u G ker[Q{x)) with P,Q distinct factors and hence prime to each 
other. Find a{x),b{x) with 

V = a{x)P{x)v + b{x)Q{x)v. 

We have 

^(f , u) = Lj{b{x)Q{x)v, u) = Lj{b{x)v, Q{x)u) = 

□ 

Lemma 4.0.4. Let x G GL{V) a semi-simple element with x = a{x). Let P{x) = 
YYi=iPi{^) ^6 decomposition of the minimal polynomial of x to irreducible factors. 
Then J : V V* maps each Vi = ker{Pi{x)) to V* = Ker{Pi{x*)) . Moreover, J is Ei 
linear on each Vi and J|y. defines a non- degenerate form on the space V^. 

Proof. If f G then Pi{x)v = 0. Now since Jx = x*J we get Pi{x*)Jv = JPi{x)v = 
and hence Jv E V*. The Ei linearity is checked using the same identity. We thus see that 
J = ®Ji with Ji = J\y. and since J is invertible, each of the maps Jj is invertible. Since 
J* = — J and J* = ©J* we see that each of the forms Jj is skew symmetric and invertible 
thus defines a symplectic space (Vi, Ji) over Ei. □ 

Proof of Theorem \4.0.S\ Let g G GL{V) be an element which is semi-simple with respect 
to the Sp{V) X Sp{V) action. The corresponding descendant is defined via the element 
X = s{g) = a{g)g which is semi-simple and belongs to GL(yy. So let x G GL(yy be a 
semi-simple element. We claim that {Gx,Hx) is a product of symmetric pairs as above. 
By the comment above 

n 

G, = l[GL{V,E,) 

1=1 

Let now h E H = SpiV, J) be an element in if^. C G^- Since h E H we have h*J = Jh. 
Since h G G^ we can write everything in blocks corresponding to the decompositions 
of V and V*. Using the previous lemma we obtain that h = diag{hi, hr) with each 
hi : Vi ^ Vi satisfy h* = JihiJ~^. Thus, 
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n 

H,^l[Sp{{Vi,Ji)/Ei) 

i=l 

This is exactly the claim. 

□ 
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